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WHAT IS CLAIMED: 



1. A method for assessing a call center, said 
method comprising the steps of: 

gathering and studying information regarding a call 
flow of the call center's interactive voice response (IVR) 
^sy^em;/ 

developing a coding sheet for the call center, the 

— c 

coding sheet summarizing a call to the call center, including 
interactions between a caller and the IV R^system and 
interactions between the caller and a live agent; 
m\ tabulating a plurality of calls to the call center 

•ait? ^ 

P on the coding sheet based on notes and/ or recordings of 

entire calls, from beginning to end; a 

•il analyzing the tabulated coding sheet to determine 

111 

pil areas of the IVR system^ that can be improved; ,and 

i5 t generating an analysis report itemizing the areas 

m of the IVR system that can be improved and suggesting ways to 

! «f improve those areas, 

£l wherein said tabulating step includes noting on the 

j " coding sheet, for each call, menu selections made by the 

caller in response to a prompt from the IVR system and a 
summary of interactions between the caller and a live agent. 

2. A method according to Claim 1, further 
comprising the step of summarizing the tabulated coding sheet 
to generate statistical data on the plurality of calls to the 
call center. 

3. A method according to Claim 1, wherein the 
analysis report generated in said generated step includes: 

noting whether a live agent performed functions 
that the IVR system can perform, 



92 



EXPRESS MAIL NO 




029404298US 




PATENT 



Attorney Docket No. 01-4008 

noting whether a live agent performed functions 
that the IVR system can be re-designed to perform, 

noting whether and how a call was transferred to 
more than one agent, 



4. A method according to Claim 1, wherein the 
analysis report generated in said generating step includes a 
suggestion to change a menu tree of the IVR system. 



analysis report generated in said generating step includes at 
least one of: 

a suggestion to re-word or re-phrase a prompt given 
by the IVR system, 

a suggestion to re-word or re-phrase a menu 
selection given by the IVR system, 

a suggestion to re-route a destination of a menu 
selection of the IVR system, 

a suggestion to enforce policies of the call 
center, in regard to action taken by an agent, 

a suggestion to re-engineer the IVR system to 
automate a function that is not currently available in the 
IVR system, and 

a suggestion to re-engineer the IVR system to 
provide a speech recognition option. 

6. A method for assessing a call center, said 
method comprising the steps of: 

developing a coding sheet for the call center, the 
coding sheet summarizing paths a caller may take during a 
call to the call center, including interactions between the 



noting at what point a call is terminated, and 
noting timing information for each call. 



5. 



A method according to Claim 1, wherein the 
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caller and an automated IVR system and interactions between 
the caller and a live agent; 

tabulating on the coding sheet, for each call of a 
plurality of calls to the call center, events that occurred 
during the call; 

analyzing the tabulated coding sheet to determine 
areas of the IVR system that can be improved; and 

generating an analysis report suggesting ways to 
improve the areas determined in said analyzing step. 



tabulating step is performed from notes taken by an analyst 
during live calls, while the analyst is listening to the 
calls . 

8. A method according to Claim 6, wherein said 
tabulating step is performed from recordings of calls. 

9. A method according to Claim 6, wherein the 
analysis report generated in said generating step includes a 
suggestion to change a menu tree of the IVR system. 

10. A method according to Claim 6, wherein the 
analysis report generated in said generating step includes at 
least one of: 

a suggestion to re-word or re-phrase a prompt given 
by the IVR system, 

a suggestion to re-word or re-phrase a menu 
selection given by the IVR system, 

a suggestion to re-route a destination of a menu 
selection of the IVR system, 

a suggestion to enforce policies of the call 
center, in regard to action taken by an agent, 



7. 



A method according to Claim 6, wherein said 
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a suggestion to re-engineer the IVR system to 
automate a function that is not currently available in the 
IVR system, and 

a suggestion to re-engineer the IVR system to 
provide a speech recognition option. 

11. A method of assessing an automated call 
routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 

Q an caller/agent dialog portion, said method comprising the 

f |l steps of: 

^ monitoring calls coming into the automated call 

m 

jlj routing system; 



recording end-to-end calls from among the calls 



□ coming into the automated call routing system; 

l tl transcribing a sequence of events for the recorded 

Cl 

is calls, including events occurring in the IVR portion and in 

ft the caller/agent dialog portion, to identify predetermined 

call events of interest; 

analyzing the transcribed calls to infer a complete 
event sequence of each of the recorded calls; and 

calculating parameters corresponding to cost 
effectiveness and usability of the automated call routing 
system, based at least in part upon information provided to 
the caller during the IVR portion. 

12. A method according to Claim 11, wherein the 
cost effectiveness parameter is measured in terms of agent 
seconds saved by a service or services capable of being 
performed in the IVR portion of a call actually being 
performed in the IVR portions of calls rather than in the 
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caller/agent portions of calls, agent seconds saved being 
defined as a difference between an amount of time it would 
normally take for an agent to provide a service to a caller 
in the caller/agent portion and an amount of time the service 
would have taken had the service been performed in the IVR 
portion. 

13. A method according to Claim 11, wherein said 
recording step occurs at a site remotely located from the 
automate call routing system. 



14. An apparatus operable to assess an automated 
call routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 
a caller/agent dialog portion, said apparatus comprising: 

means for monitoring calls coming into the 
automated call routing system; 

means for recording end-to-end calls from among the 
calls coming into the automated call routing system; 

means for transcribing a sequence of events of each 
of the recorded calls, including events occurring in the IVR 
portion and in the caller/agent dialog portion, to identify 
predetermined call events of interest; 

means for analyzing the transcribed calls to infer 
a complete event sequence of each of the recorded calls; and 

means for calculating performance parameters 
corresponding to cost effectiveness and usability of the 
automated call routing system, based at least in part upon 
what, if any, information was obtained by the caller during 
the IVR portion. 
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15. An apparatus according to Claim 14, wherein 



the cost effectiveness parameter is measured in terms of 
agent seconds saved by a service or services capable of being 
performed in the IVR portion of a call actually being 
performed in the IVR portions of calls rather than in the 
caller /agent portions of calls, agent seconds saved being 
defined as a difference between an amount of time it would 
normally take for an agent to provide a service to a caller 
in the caller/agent portion and an amount of time the service 
would have taken had the service been performed in the IVR 
portion. 

16. An apparatus according to Claim 14, wherein 
said means for recording is located at a site remote from the 
automate call routing system. 



routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 
an caller/agent dialog portion, said system being operable 
to : 

monitor calls coming into the automated call 
routing system; 

record end-to-end calls from among the calls coming 
into the automated call routing system; 

transcribe a sequence of events for the recorded 
calls, including events occurring in the IVR portion and in 
the caller/agent dialog portion, to identify predetermined 
call events of interest; 

analyze the transcribed calls to infer a complete 
event sequence of each of the recorded calls; and 



17. A system for assessing an automated call 
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calculate parameters corresponding to cost 



effectiveness and usability of the automated call routing 
system, based at least in part upon information obtained by 
the caller during the IVR portion. 



cost effectiveness parameter is measured in terms of agent 
seconds saved by a service or services capable of being 
performed in the IVR portion of a call actually being 
performed in the IVR portions of calls rather than in the 
caller /agent portions of calls, agent seconds saved being 
defined as a difference between an amount of time it would 
normally take for an agent to provide a service to a caller 
in the caller/agent portion and an amount of time the service 
would have taken had the service been performed in the IVR 
portion. 

19. A system according to Claim 17, wherein 
recording of the end-to-end calls occurs at a site remotely 
located from the automate call routing system. 



for implementing a method for assessing an automated call 
routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 
an caller /agent dialog portion, said computer program product 
comprising code for: 

monitoring calls coming into the automated call 
routing system; 

recording end-to-end calls from among the calls 
coming into the automated call routing system; 



18. A system according to Claim 17, wherein the 



20. A computer program product embodying a program 
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transcribing a sequence of events for the recorded 
calls, including events occurring in the IVR portion and in 
the caller/agent dialog portion, to identify predetermined 
call events of interest; 

analyzing the transcribed calls to infer a complete 
event sequence of each of the recorded calls; and 

calculating parameters corresponding to cost 
effectiveness and usability of the automated call routing 
system, based at least in part upon information obtained by 
the caller during the IVR portion. 



21. A computer program product according to Claim 
20, wherein the cost effectiveness parameter is measured in 
terms of agent seconds saved by a service or services capable 
of being performed in the IVR portion of a call actually 
being performed in the IVR portions of calls rather than in 
the caller/agent portions of calls, agent seconds saved being 
defined as a difference between an amount of time it would 
normally take for an agent to provide a service to a caller 
in the caller/agent portion and an amount of time the service 
would have taken had the service been performed in the IVR 
portion. 



22. A computer program product according to Claim 
20, wherein recording of the end-to-end calls occurs at a 
site remotely located from the automate call routing system. 
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